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(57) ABSTRACT 

A rating of a plurality of ratings is predicted. The rating is 
associated with a user of a plurality of users and the rating 
corresponds to an item of a plurality of items. One of the 
plurality of ratings, corresponding to at least one of the 
plurality of items, is provided for each of the plurality of 
users. A predictability relation between ones of the plurality 
of users and other ones of the plurality of users is calculated 
based on ratings provided by users. One of a plurality of 
nodes is assigned to each of the plurality of users. Ones of 
the plurality of nodes are connected with other ones of the 
plurality of nodes by a plurality of edges based on the 
predictability relation. A graph which includes the plurality 
of nodes and the plurality of edges is searched for a path 
from a node assigned to the user of the plurality of users to 
another node assigned to another user of the plurality of 
users. The rating of the plurality of ratings associated with 
the user of a plurality of users is calculated based on the path 
and the predictability relation. If desired, a predicted rating 
may be produced for identifying products and customers in 
an e-commerce applications. 

22 Claims, 9 Drawing Sheets 
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SYSTEM AND METHOD FOR 
COLLABORATIVE FILTERING WITH 
APPLICATIONS TO E-COMMERCE 

5 

FIELD OF THE INVENTION 

The present invention relates generally to making a pre- 
diction about a user based on data provided in association 
with other users. In particular, a rating associated with a user 
is forecasted based on a predictability graph. Furthermore, 10 
the present invention relates to an automated system and 
method for providing recommendations of items for sale in 
an e -commerce environment. 

BACKGROUND OF THE INVENTION 15 

A computing environment offers an opportunity to collect 
information relating to the various preferences of users. User 
preferences may take the form of a rating which is associated 
with an item. A rating may be a quantitative measure of a 2Q 
users relative like or dislike of an item. For example, a user 
purchasing compact discs, books, or videos over the Internet 
may provide an integer, in a given range, indicating his/her 
satisfaction with a product available for sale. 

Rating information provided by a group of users may be 25 
useful for recommending items to a user. In other words, the 
preference of a user may be predicted based on ratings for 
items provided by a group of users. One user may be found 
"similar" in his preferences to other users. Users with 
"similar" ratings may be used to predict each other's pref- 30 
erences. Deducing the preferences of a given user by exam- 
ining information about the preferences of other "similar" 
users is often referred to as collaborative filtering. Users 
collaborate by each rating a subset of a set of items. The 
collective knowledge attained from the collaborative rating 35 
of items may then be used to make recommendations. For 
example, if, based on the collective knowledge, it is pre- 
dicted that an item would be highly rated by a user, the item 
may be recommended to the user. 

Collaborative filtering may be used to make recommen- 40 
dations to customers purchasing items for sale on the World 
Wide Web. Alternatively, collaborative filtering may be used 
to make marketing recommendation to vendors using the 
World Wide Web, In general, due to the nature of a distrib- 
uted computer environment, collaborative filtering may be 45 
used to make recommendations and/or customize prefer- 
ences of users involved in electronic transactions or 
e-commerce. Suppose, for example, that the amount of time 
a user spends viewing a Web page is regarded as an implicit 
rating of the Web page by the user. Users with "similar" 50 
viewing habits may be detected. Based on the observed 
viewing habits of users, recommendations may be calculated 
which estimate the interest a user may take in a particular 
Web page. In this way, a Web page estimated to be of interest 
to a particular user may be recommended to the user. For 55 
instance, if a user spends much time browsing Web pages 
detailing information relating to running, a Web page giving 
a comparative study of running shoes may be recommended 
to the user. The Web page giving the comparative study of 
running shoes may be recommended based on the amount of go 
time other users, viewing running related Web pages, spend 
viewing the study. 

Several collaborative filtering engines are currently avail- 
able. A discussion of such collaborative filtering engines 
may be found, for example, in U.S. Pat. No. 4,870,579 and 65 
U.S. Pat. No. 4,996,642 both issued to John B. Hey 
(employed in collaborative filtering technology offered by 



,541 Bl 

2 

LikeMinds Inc.), and Upendra Shardanand and Pattie Maes 
(a founder and former director of Firefly Network, Inc.), 
"Social Information Filtering: Algorithms for Automating 
Word of Mouth," Proceedings of CHI '95, Denver, Colo., 
1995,pages 210-217. 

The technology employed by LikeMinds Inc., as dis- 
closed in U.S. Pat. Nos. 4,870,579 and 4,996,642 involves 
random sampling of users. A measure of "agreement 
strength" between a current user and the randomly sampled 
users is computed. A subset is then chosen of the randomly 
sampled users. Each member of the subset corresponds to 
either a relatively high "measurement strength" or a rela- 
tively high item coverage. Item predictions are computed 
based on a "closeness" function of pairs of ratings by 
member of the subset. 

The technology employed by Firefly Network, Inc. 
involves computing a Pearson r coefficient to measure the 
"similarity" between two users. Users who are "similar" to 
a given user are identified. Predictions are made by forming 
a weighted average of ratings provided by the "similar" 
group of users. The weighting factor used to form the 
average of ratings of items is made proportional to the 
Pearson coefficient. 

SUMMARY OF THE INVENTION 

A rating of a plurality of ratings is predicted. The rating 
is associated with a user of a plurality of users and the rating 
corresponds to an item of a plurality of items. One of the 
plurality of ratings, corresponding to at least one of the 
plurality of items, is provided for each of the plurality of 
users, A predictability relation between ones of the plurality 
of users and other ones of the plurality of users is calculated 
based on ratings provided by users. One of a plurality of 
nodes is assigned to each of the plurality of users. Ones of 
the plurality of nodes arc connected with other ones of the 
plurality of nodes by a plurality of edges based on the 
predictability relation. A graph which includes the plurality 
of nodes and the plurality of edges is searched for a path 
from a node assigned to the user of the plurality of users to 
another node assigned to another user of the plurality of 
users. The rating of the plurality of ratings associated with 
the user of a plurality of users is calculated based on the path 
and the predictability relation. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is best understood from the following 
detailed description when read in connection with the 
accompanying drawings. It is emphasized that, according to 
common practice, the various features of the drawings are 
not to scale. On the contrary, the dimensions of the various 
features are arbitrarily expanded or reduced for clarity. 

FIG. 1 illustrates steps in a collaborative filtering process 
in accordance with an exemplary embodiment of the present 
invention; 

FIG. 2 illustrates a process for calculating the set of users 
horted by a given user in accordance with an exemplary 
embodiment of the present invention; 

FIG. 3 illustrates a process for calculating the set of users 
who predict a given user, and the associated predictor values 
in accordance with an exemplary embodiment of the present 
invention; 

FIG. 4 is a graph of an exemplary predictability and 
honing relation in accordance with an embodiment of the 
present invention; 

FIG. 5 shows an exemplary tree structure for classifying 
Compact Discs (CDs) into categories; 
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FIGS. 6Aand 6B illustrate a method tor responding to an 
"extreme" query for items in a particular category which a 
given user is predicted to like in accordance with an exem- 
plary embodiment of the present invention; 

FIG. 7 illustrates a method for responding to a "target" 
query for a list of users who are predicted to like a given item 
in accordance with an exemplary embodiment of the present 
invention; and 

FIG. 8 is a block diagram of an exemplary apparatus for 
predicting a rating, which corresponds to an item and which 
is associated with a user, over a computer network in 
accordance with an embodiment of the present invention. 

DETAILED DESCRIPTION OF THE 
INVENTION 

Horting and Predictability 

Suppose that N users are involved in a collaborative 
filtering application. Suppose further that there are K items 
which may be rated. FIG. 1 illustrates steps in a collabora- 
tive application in accordance with an exemplary embodi- 
ment of the present invention. In step 102 each of the N users 
may provide ratings for some (but possibly none) of the K 
items. Define a binary matrix Me{0,l}^ by 



1 if user / rated item j 
0 otherwise 



i\ horts ; 2 if i^rvy/l/g^F 



(1) 



where F is a predetermined value in (0,1]. Alternatively, a 
horting relation may be defined by 



ft horts i 2 if ^rW.J/^^F or [fyHKjaG 



(2) 



For a pair <s,t>E{-l,+l}x{t v0 , . . . , t v l } define a 
transformation on ratings by 
T^rJ-s'r+t, 

where r£{l, . . . , v}. For example, if t_ 10 =2 and l_ a ]=2v are 
5 chosen, then 3r f €{l, . . . , v} such that T_] Xr')E{l, . . . , v}. 
If tj 0 =l-v and t 1(1 -v-l are chosen, then 3r"E{l, . . . , v} 
such that T a ,(r")E{l, . . . , v}. A predictability relation may 
be defined by 
i 2 predicts i 2 if 
10 (i) i a horts u; 

(ii) 3<s,t>e{-l,+l}x{t, 0 , • ■ ■ , t^ i} such that 



Define the set 

tf r {je{i, .... K}.M ir l}. 

Thus, the set R, is a set indicating all items rated by the i th 
user. Note that the cardinality of the set R,., namely |RJ= 
2yM^, is the row sum for the i th row. The number of users 
who have rated an item j may be expressed by the column 
sum 2,M lV . 

A user may rate an item by providing a corresponding 
integer in a given range. If the i th user rated the j' A item, i.e. 
M.-j-l, the rating may be denoted by r iV ={l, . . . , v}. For 
example, a so-called seven point scale, i.e. v=7, is com- 
monly used. A so-called thirteen point scale, i.e. v«13, is 
also commonly used, though there is evidence to support the 
notion that ratings r, v varying between 1 and 7 provide users 
with a sufficiently discriminating scale (see Shardanand and 
Maes Supra). Note that odd values of V allow a user to 
express neutrality, while even values of V may force a user 
to express a positive or negative opinion. 

In the following two relations, horting and predictability, 
will be defined on a set of users. Let ij and i 2 indicate two 
users of a set of users. 



40 



where G is a predetermined threshold. Note that horting is 
reflexive but is neither symmetric nor transitive. Thus, the 
terminology i 2 horts i 2 is employed, but not the term cohorts. 
The terminology i 3 horts i 2 expresses the notion that suffi- 
ciently many jointly rated items exist between user i 2 and 
user i 2 , from user i] 's perspective, to decide whether user i 2 
predicts user i x in some sense. A calculation to decide 
whether user i 2 predicts user i, will be given below. 



z 



1ft. n*»i 



20 



25 



where U is a predetermined threshold. D Jf (ii> h) 
represents a measure of distance between the ratings 
of user i 3 and the (T^,) transformed ratings of user i 2 , 
on the set of items rated by both users, normalized by 
the cardinality of the set of items rated by both users. 
For example, if D 3 i0 (i l9 i 2 )=0 then user i 2 behaves 
identically to user i 19 and if D a a (i : , i 2 )-0 then user 
i 3 consistently rates items one unit higher than user 
i 2 . If D_i, v +i(ii> i 2 )=0 then user i 2 behaves identically 
opposite to user i 3 . 
In step 104 a predictability relation between users may be 
calculated. Note that the predictability relation as defined 
30 above is reflexive, but is neither symmetric nor transitive. 
Let H,- denote the set of users who are horted by user i]. Let 
P ( . denote the set of user who predict user i 3 . Therefore, by 
definition, P t - 532 H f . In other words, in order to calculate 
predictability (according to the above definition) horting 
35 may be calculated first. 

Assume the variable USER1 is set to a given user. FIG. 2 
illustrates a recipe for calculating H USER1 . In step 202 the 
variable USER2 may be set to the first user of N users. In 
step 204 an item index J may be set to 1, and two counters 
COUNT1 and COUNT2 may be set to 0. COUNT1 counts 
the number of items found that have been rated by USER1, 
While COUNT2 counts the number of items found that have 
been rated by both USER1 and USER2. 

Let ITEM] denote the set of users who rated the V h item. 
Suppose that the sets ITEM], l^l^K, are sorted such that 
45 lITEM]! = • - . ^[ITEMjJ. The sets ITEM] may be accessed 
using inverted indexes. For a discussion of inverted indexes 
see, for example, C. Faloutsos, 'Access Methods for Text/ 
ACM Computing Surveys, Vol. 17, No. 1, pp. 50-74, 1985, 
incorporated by reference herein in its entirety. In step 206 
50 a search, such as, for example, a binary (logarithmic) search 
may be made to determine if USERl€3TEM y , i.e. a deter- 
mination is made whether USER1 rated item J. As the sets 
ITEM], l^l^K, are sorted the sets with lowest cardinality 
may be searched first to determine if USER16ITEM y . If the 
55 question of whether USER2eH tAS£7?1 , i.e. whether USER1 
horts USER2, may be determined "early" in the process, i.e. 
for low values of J. the ("later") largest sets ITEM1 may not 
be searched. Thus, it may be advantageous to sort the set 
ITEM], l^l^K in order of increasing cardinality. It may 
60 also be advantageous to sort each set ITEM] (the set of users 
who rated the 1 th item) in order of increasing users, i.e. 
ITEM] may be stored as an ordered set {1 3 , . . . , l m }, where 
ljil 2 = . . ■ =l m . Sorting each set ITEM] in order of 
increasing users may increase the efficiency of a search, as 
65 it makes a binary search, for example, possible. 

If USERlEITEMy then in step 208 the variable COUNT1 
may be incremented, i.e. COUNT1 may be reset to 
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C0UNT1+1. If USERlelTEMj, then in step 218 the vari- 
able J may be incremented and a search for the next user may 
be reinitiated in step 206. In step 210 a search, such as, for 
example, a binary (logarithmic) search may be made to 
determine if USER2EITEM y , i.e. a determination is made 5 
whether USER2 rated item J. If USER2 eiTEM y then the 
variable COUN'12 may be incremented in step 212. In step 
214 it is determined whether COUNT2^T, where T«min 

If it is determined in step 214 that COUNT2^T, then in 10 
step 216 it may be reported that USER1 horts USER2, i.e. 
USER2eR^ ry?1 . Once a determination is made that 
USEI^GR^^, the process of FIG. 2 may be reset for the 
next user. Thus, in step 226 USER2 may be incremented, 
and provided that a determination is made in step 228 that 15 
not all users have yet been searched (i.e. USER2^N) then 
the process may be reset to step 204. Once all users have 
been searched the process may terminate in step 230. 

If it is determined in step 210 that USER2EITEM,, then 
in step 222 a determination is made whether there may be a 20 
need to continue searching, i.e. whether given that 
USER2g ITEM, it may still be possible that USER1 horts 
USER2. In other words, if it is determined in step 222 that 
C0Um2+|R^* J-COUNTl<T then in step 224 it may be 
reported that USER1 does not hort USER2, i.e. 2 5 



USER2*R L 



Once a determination is made that 



USER2g Ruseri* tne process may be reset for the next user. 
Thus, in step 226 USER2 may be incremented, and provided 
that a determination is made in step 228 that not all users 
have yet been searched (i.e. USER2^N) then the process 30 
may be reset to step 204. Once all users have been searched 
the process may terminate in step 230. 

If it is determined in step 222 that COUN^+lR^^^I- 
COUNTl^T, then in step 218 the variable J may be 
incremented, and the process may be resumed for the next 35 
item in step 206. 

If it is determined in step 214 that COUNT2<T, then in 
step 220 a determination is made whether COUNTl= 
l R c«ar*il' If il is determined in step 220 that COUNT1- 
l R i7£E*il tDen it mav be reported in step 224 that USER1 40 
does not hort USER2, i.e. USER2gR CAS£/?:i . If, on the other 
hand, it is determined in step 220 that COUNTl^R^^^-J, 
then in step 218 the variable J may be incremented. 

Although not explicitly shown in FIG, 2 it will be 
understood by one of ordinary skill in the art that as the 45 
relation of horting is reflexive, the process may be skipped 
for the case of USER2«USER1. 

FIG. 3 illustrates a recipe for calculating P USER1 after 
having calculated H USER1 . Further, if USER2 predicts 
USER1 then the process illustrated in FIG, 3 provides s* and 50 
t* such that 

D^,.(USERl,USER2)=min J ,D^(USERl J USER2). 
The pair (s*,t*) is referred to herein as the predictor values. 
In step 302 the variable s may be set to -1, and the variable 
Win may be set to 'inf\ Herein, the value 'inf* indicates a 55 
value which is larger than any other given value. In step 304 
the variable t may be set to T s 0 . In step 306 D s /USER1, 
USER2) may be computed, where it may be assumed that 
USEI^EH^^j. In step 308 a determination may be made 
whether D J> ,(USERl,USER2)imin(U,Win). In other 60 
words, in step 308 a test may be performed to determine 
whether D Jf (USERl,USER2) is the lowest value computed 
thus far by the process, and whether D J ,(USER1,USER2) is 
also below the predetermined threshold U. 

If il is determined in step 308 that D Jf (USERl,USER2) 65 
^min(U,Win) then in step 310 the variable Win may be set 
to D T ,(USER1,USER2), Wins may be set to s, and Wint may 



be set to t. In step 312 variable t may be incremented. In step 
314 a determination may be made whether t=l sl . If it is 
determined in step 314 that t^t^ lt then the sub-process of 
steps 306, 308, 310, 312, and 314 may be repeated. If it is 
determined in step 314 that the value of t exceeds t lt then 
in step 316 the variable s is reset to s+2. In step 318 a 
determination may be made whether s=l. If it is determined 
in step 318 that s«l, then the sub-process of steps 304, 306, 
308, 310, 312, 314, 316, and 318 may be repeated. 
Otherwise, if it is determined in step 318 that s*l, then in 
step 320 a determination may be made whether the variable 
Win has taken on any value other than the maximal value 
'inf (i.e. if Win<'inf*). 

If in step 320 it is determined that Win ^' inf, then in step 
322 it may be reported that USER2 predicts USER1 (i.e. 
USER2eP t/i£/21 ), and further that <s*,t*>«<Wins,Wint> 
are the corresponding predictor values. Hence, by applying 
the process illustrated in FIG. 3 to each elements 



USER2GH, 



the predictability relation P L 



may be 



computed. 

Once a predictability relation V USER1 has been calculated, 
the relation may be represented by a directed graph. A graph 
includes both a set of nodes and a set of directed edges. In 
step 106 of FIG. 1 each of the N users may be assigned a 
node of a set of N nodes. In step 108 the set of N nodes may 
be connected by directed edges of the directed graph based 
on the predictability relation. For example, if a first node is 
assigned to USER1 and a second node is assigned to 
USER2, and if USER2 predicts USER1, then a directed edge 
may connect the first node to the second node. Note that the 
relation of horting may also be represented by a directed 
graph. 

An exemplary graph, representing both a predictability 
and a horting relation is shown in FIG. 4. In FIG. 4 a solid 
directed edge between two nodes represents the relation: a 
user assigned to the destination node predicts a user assigned 
to the origin node. Further a dashed directed edge in FIG, 4 
represents the relation: a user assigned to the origin node 
horts a user assigned to the destination node. For example, 
as shown in FIG. 4, user : horts user 3 and user 5 , but user 3 and 
user 5 do not predict userl. Further, user 2 , user 4 , and user 6 , 
each predict user^ Note that although, trivially, each user 
both horts and predicts himself/herself, these edges are not 
considered in this graph. 

Suppose that a given user, say user,-, has not rated a given 
item, say item j . Suppose further that a predicted rating of 
the given item by the given user is sought. In step 110' a 
predictability graph may be searched for the 'shortest 5 path 
(i.e. the least number of edges) connecting between the 
given user and other users which rated the given item. In 
other words, a predictability graph may be searched for the 
'shortest' path connecting user,- with another user in P Msrri 
who has rated item j. The graph may be searched using any 
of a variety of graph searching algorithms, such as, for 
example, a breadth first search . Details on shortest-path 
graph search algorithms may be found, for example, in T. 
Cormen, C. Leiserson, and R. Rivest, Introduction to 
Algorithms, MIT Press, Cambridge Mass., 1992. For 
example, in the graph shown in FIG. 4, let the given user be 
user a , and assume that both user 7 and user 12 rated item j. 
Both user 7 and user 12 are a distance of 2 edges from user 2 
in the graph of P Mcri . These two equi-length paths are the 
path from user 1 to user 2 to user 7 , and the path from user a to 
user 4 to user 12 . 

In step 112 a predicted rating of item j by user,- may be 
calculated based on the 'shortest' path(s) found by searching 
the graph in step 110. The predicted rating of item j may be 



01/22/2004, EAST Version: 1.4.1 



US 6,487,541 Bl 
7 8 

calculated by composing transformations on rating associ- rated may be partitioned into categories arranged in a 
ated with users which are assigned to nodes along the hierarchical or tree structure. The set of items associated 
'shortest* path(s) in the graph. For example, suppose a with a parent node of the tree structure is the union of the 
directed 'shortest* path may be represented by sets of items associated with child nodes of the parent node. 

5 The root node, therefore, may be associated with the entire 
set of items rated. FIG. 5 shows an exemplary tree structure 
Ti , of a hierarchical partition of categories for classifying Com- 
pact Discs (CDs). In FIG. 5 the root node is associated with 
a set of compact discs (CDs). The child nodes of the root 
where a prediction is sought for a rating of item j by given jo nodes may be associated with a set of folk CDs, a set of jazz 
user user,-, user, rates item j, and <s* 1 ,t* 3 >, . . . , <s* ? ,t%> CDs, a set of classical music CDs, a set of rock CDs, and a 
are predictor values corresponding to the path. A prediction set of soundtrack CDs. Each of these categories may in turn 
associated with such a directed path may be calculated by be subdivided into more child categories. For example, the 



15 



node associated with the set of classical CDs may have child 

nodes associated with a set of early music CDs, a set of 

The prediction sought may be given as a weighted average romantic music CDs, a set of baroque music CDs, a set of 

of the value of the function given by (3) computed for each classics CDs, and a set of modern classical music CDs. Each 

'shortest* path. of these sub-categories of classical music may again be 

Alternatively, the value of function (3) may be computed subdivided further. 

for each path in the graph, from a given user to any other 2Q Once a category of items is identified, a computer system 

user (who rated a given item), having less than a predeter- may be queried to provide a user with recommendations for 

mined number of edges. A weighted average of the value(s) items which a given user has not rated, and which the given 

of function (3) associated with each of these paths may serve user is predicted to like the most (provide a relatively high 

as the predicted rating of the given item by the given user. rating for) or the least (provide a relatively low rating for). 

. . « .- i m- w, , . n An "extreme" query may be characterized as a query for 

Updating a Predictability Relation 25 u- u • • j- * j * . l- l/i \ 

r & J items which a given user is predicted to rate high(low) 

A data structure may be maintained in order to store a compared with prediction for ratings by the given user of 

graph of a predictability relation. The data structure of the other items. 

predictability graph may store the nodes associated with FIGS. 6Aand 6B illustrate a method for responding to an 

users, as well as the edges connecting between nodes based 30 "extreme** query for items in a particular category. Suppose 

on the predictability relation. Additional information may be a given user is provided along with a given set of items in 

stored in the data structure. For example, as each node is a category, denoted CAT. In step 602 a choice may be made 

associated with a user, ratings provided by a user, and whether to seek a highest rating prediction or a lowest rating 

predicted ratings previously computed for a user may also be prediction for the given user. If a highest rating prediction is 

stored with the node associated with the user. In addition, 35 sought in step 602, then in step 604 the variable BEST_RAT 

predictor values associated with an edge in the graph may be may be set to 'inf \ If a lowest rating prediction is sought in 

stored with the edge. Optionally, a data structure may be step 602, then in step 606 the variable BEST_RAT may be 

maintained for a horting relation. If a data structure is set to 0. In step 608 the variable J indexing a plurality of 

maintained for a horting relation, it may be useful to store items may be set to 1. In addition, in step 608 the variable 

the values D s Ji l9 i 2 ), for each pair <s,t>, in addition to an 40 WINNER may be set to 0. The variable WINNER indicates 

edge connecting user i a with user i 2 . In this case predict- which item (if any) corresponds to either the highest or 

ability may be calculated "on-the-fly". lowest rating prediction for a given user. In step 610 a 

Updating a data structure for a predictability graph may determination may be made whether the given user has rated 

be necessary when a new user is added, or when an existing the J'* item in the category CAT. If the user has already rated 

user modifies (adds or changes) his/her current ratings for an 45 the J' A item, then in step 622 the variable J is incremented, 

item or item(s). Hence, when performing the steps of the If in step 610 it is determined that the given user has not 

method illustrated, for example, in FIG. 1, some computa- rated the item, then in step 612 the variable VAL may be 

tions may be performed "on-the-fly**. If a given user is new assigned the value of the predicted rating for the j'* item in 

or if the given user modified his/her ratings, the edges the category CAT for the given user. Such a predicted rating 

originating from the node assigned to the given user in the 50 may be obtained, for example, by the method illustrated in 

graph, and related information (e.g. predictor values), may FIG. 1. 

be recomputed. If new users have not been added and Note that as the predictability relation may not necessarily 

existing user have not modified their ratings then a predicted be updated, it may not be necessary to repeat steps 102, 104, 

value may be calculated by performing steps 110 and 112 of 106, and 108 of FIG. 1 for every computation of a predicted 

the method illustrated in FIG. 1. 55 rating. A predicted rating may be computed by performing 



Queries 



steps 110 and 112 of FIG. 1. 

In step 614 a determination may be made, consistent with 
Using a method in accordance with an embodiment of the the determination made in step 602, whether the highest or 
present invention, a predicted rating, of a given item for a lowest rating prediction is sought for the given user. If a 
given user based on the ratings of other users, may be 60 lowest rating prediction is sought in steps 602 and 614, then 
calculated. The predicted rating calculated may be viewed as a determination may be made in step 616 whether the 
a response to a query, submitted to a computer system, for variable VAL is bigger than or equal to the variable BEST_ 
an estimate of the given user*s rating of the given item. RAT. If a highest rating prediction is sought in steps 602 and 
Various other queries may also be answered by using, the 614, then a determination may be made in step 618 whether 
calculation of a predicted rating as a building block. 55 the variable VAL is less than or equal to the variable 

Suppose that items rated by users are classified in a BEST_RAT. If in step 616, it is determined that VAL is 
category hierarchy or tree. In other words, the set of items strictly less than BEST_RAT, then in step 620 the variable 
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WINNER may be set to the j' A item in the category CAT, and 
the variable BEST„RAT reset to VAL. If in step 616, it is 
determined that VAL is strictly greater than BEST_RAT, 
then in step 620 the variable WINNER may be set to the ¥ h 
item in the category CAT, and the variable BEST_RAT reset 5 
to VAL. Thus, if in step 616 (step 618) the predicted rating 
VAL, calculated in step 612, is found less than(greater than) 
the current best rating BEST_RAT, then the value of 
BEST_RAT may be reset to VAL before incrementing the 
variable J in step 622. In this manner it may be possible to 
keep track of the item corresponding to the highest or lowest 
predicted rating. 

If either in step 616 VAL is determined to be greater than 
or equal to BEST_RAT or in step 618 VAL is determined to 
be less than or equal to BEST_RAT, then in step 622 the 
variable J may be incremented. In step 624 a determination 15 
may be made whether all items in the category CAT have 
been considered. In other words, is the item index J less than 
or equal to the cardinality of the set of items comprising the 
category CAT (catsize(CAT)). If all the items in the category 
CAT have been considered, i.e. if J>catsize(CAT), then in 20 
step 626 a determination may be made whether the variable 
Winner has the value 0. In other words, were any items 
found, corresponding to highest or lowest ratings, in cat- 
egory CAT. 

Note that ratings vary between 1 and v. Hence, if the 25 
Winner =0, then in step 628 it is reported that no items were 
found. On the other hand, if Winncr*0, then in step 626 the 
item (Winner), having the highest or lowest rating, is 
reported as well as the corresponding predicted rating 
(BEST_RAT). For example, if all the items in the category 30 
CAT have been rated by the given user, then Winner may 
retain the value 0 throughout the process illustrated in FIG. 
6, and no items corresponding to (highest or lowest) pre- 
dicted ratings may be found. 

If in step 624 the index J is less than catsize(CAT) (the 35 
number of item in the category CAT) then the sub-process 
comprising the steps 610, 612, 614, 616, 618, 620, 622, 624 
may be repeated. In other words, assuming the given user 
has not rated the (J+l)'* item, the predicted rating associated 
with the (J+1)' A item in the category CAT may be compared 40 
with the current predicted rating BEST_RAT. 

Optionally, BEST_RAT may be set to an upper threshold 
instead of being set to 'inP in step 604. Setting BEST__RAT 
to an upper threshold in step 604 causes any items corre- 
sponding to predicted ratings with value less than the upper 45 
threshold to be considered as a candidate for lowest pre- 
dicted rating. Further, BEST_RAT may be set to a lower 
threshold instead of being set to 0 in step 606. Setting 
BEST_RAT to a lower threshold in step 606 causes any 
items corresponding to predicted ratings with value greater 50 
than the lower threshold to be considered as a candidate for 
highest predicted rating. 

A method for responding to an "extreme" query, such as, 
for example, the process illustrated in FIG. 6 may have 
applications in electronic commerce or e-commerce. 55 
e -commerce refers to the process of trading goods and 
commodities by electronic means, for example, purchases 
made over the Internet. The increasing popularity of the 
Internet has made c-commercc applications of commercial 
importance. In particular, a method such as, for example, the 60 
process illustrated in FIG. 6 for responding to an "extreme" 
query, may be used to make recommendations to users in 
e-commerce applications. It may be desirable, for example 
for marketing purposes, to predict the types of products 
which may be (most or least) preferred by a customer. The 65 
predicted (preferred) items may be provided to a target 
customer. 
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For example, consider a customer interested in purchasing 
classical music CDs. Suppose that the CDs have been 
categorized as illustrated in FIG. 5. If the customer is, for 
example, browsing Web pages concerning early music, then 
a method for responding to an "extreme" query, may be used 
to automatically predict which CD in the early music 
category the customer may rate highest. The CD predicted to 
be rated highest by the customer may be recommended to 
the customer by, for example, embedding a banner adver- 
tisement in the Web pages viewed by the customer. Further, 
if the customer had already rated all available early music 
CDs, or if no ratings may be found, the process for respond- 
ing to an "extreme" query may be automatically repeated for 
the parent category of classical CDs. Any of the classical 
CDs predicted to be rated highest by the customer may then 
be recommended to the customer. 

Responses to other queries may also be deduced by 
building upon a method for predicting ratings, such as, for 
example, the method illustrated in FIG. 1. For example, a 
"target" query may be characterized as a query for a list of 
users who are predicted to like (rate highly) a given item. 
Further, a list of users predicted to like a given item may be 
provided in sorted order of ratings. That is, customers 
corresponding to higher ratings of the given item may 
appear at the top of the list. 

FIG. 7 illustrates a method for responding to a "target" 
query for a list of users who are predicted to rate a given item 
higher than other users. Suppose that a total of Nuser users 
are involved in a collaborative filtering application. Let 
LENGTH be the length of the list of users sought. In the 
exemplary process illustrated in FIG. 7 two lists may be 
maintained: RATS[], a list of predicted ratings; and USER 
[•] a list of corresponding users. In step 702 the (LENGTH) 
entries of a list RATS[ ] may be initialized to 0, and the 
variable I, indexing users, may be set to L In step 704 a 
determination may be made whether the I th user has rated the 
given item (ITEM). If the I th user rated the given item, then 
in step 726 I is incremented. If the I th user has not rated the 
given item, then in step 706 a predicated rating (VAL= 
PR ATING(I,ITEM)) of the given item by the V h user may be 
calculated. Such a predicted rating may be obtained, for 
example, by the method illustrated in FIG. 1. In addition, in 
step 706 a variable J may be set to LENGTH+1. 

Note that as the predictability relation may not necessarily 
be updated, it may not be necessary to repeat steps 102, 104, 
106, and 108 of FIG. 1 for every computation of a predicted 
rating. A predicted rating may be computed by performing 
steps 110 and 112 of FIG. 1. 

In step 708 a determination may be made whether the 
predicted rating VAL calculated in step 706 is less than the 
(J-1)'* entry in the list RATS[ ], namely RATS[J-1]. If in 
step 708 it is determined that VAL<RATS[J-1], then the 
process of FIG. 7 may proceed to step 714. If in step 708 it 
is determined that VAL is greater or equal to RATS[J-1], 
then in step 710 J may be decremented. In step 712 a 
determination may be made whether J>1. If J is determined 
to be greater than 1, then the process may proceed to step 
708. If J is determined to be less than or equal to 1, then in 
step 714 a determination is made whether J=LENGTH+1. If 
J is determined in step 714 to be LENGTH+1, the I may be 
incremented in step 726. Note that steps 708, 710, 712, and 
714, utilize the variable J (a list positioning index) to 
indicate the magnitude of the predicted rating VAL as 
compared with the ratings stored in the list RATS[ ]. 

If it is determined in step 714 that J^LENGTH+1, then in 
step 716 the variable k may be set to LENGTH. Note that if 
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at step 714 it is determined that J*LENGTH+1, then the Implicit and Explicit Ratings 

value VAL and user I may be inserted into the lists RATS[1 „ , 

i „ prnn / . ... . , . . , , V Ratings may be collected directly from users, for 

and uSERi l.respectively, at the position indicated by J. . & , J „ . . , ,. J, ^ 

^ . . -no » u i n j t a \c example, by means of a questionnaire (online or offline). 

Thus, in step 718 the values of k and J are compared. If it n . 1 ^ n u « j • i- -.i * 

. , / j • t q # i i i j .I . . „ A rp cri i r Ratings may, however, optionally be collected implicitly, tor 

is determined in step 718 that k«J, then in step 724 RATSfk] 5 & , , J \ , . ' 1 , * f J ' 

may be set to VAL, and USER[k] may be set to I. If in step ? sample, by tracking a user s actions in a computer system. 

718 it is determined that k*J, then in step 720 RATS[k] may ta P^" m W * collected for instance, by using a 

be set to RATS[k-l], and USER[k] may be set to USER weighted keyword frequency distribution analysis of 

[k-1]. In step 722 k may be decremented, i.e. k is reset to browsed Web P a S es and/or o£ 861601101,5 made wlthlD Web 

k-1. From step 722 the process may proceed to step 718. 10 P a & es - 

From step 724 the process of FIG. 7 may proceed to step Exemplary Computer Apparatus 
726 in which I may be incremented. In step 728 a determi- 
nation may be made whether all users involved were FIG - 8 ™ a block diagram of an apparatus for predicting 
considered, i.e. a determination is made whether I>Nuser. If a ratin & which corresponds to an item and which is asso- 
I is greater than Nuser, then all user have been considered, is ciated with a user, over a computer network. In the erabodi- 
If I is greater than Nuser, then in step 730 all nonzero entries mem depicted in FIG, 8, multiple client computers 802 may 
RATS[m] and USER[m], m-1, . . . , LENGTH, may be access a 806 > for example a Web server, over a 
reported. The nonzero entries in the list RATS[-] are pre- network 804 - Server 806 ma y have a memorv 810 35 wel1 ™ 
dieted ratings (in non-increasing order) of the given item for a cache 808 - ^ server ma Y former includ e a Central 
the corresponding users in the list USER[-]. If I is less then 20 Processing Unit (CPU) 812 for processing information, and 
or equal to Nuser, then from step 728 the process may a disk 814 for storing data. Ratings may be collected 
proceed to step 704, i.e. the (I+l)" 1 user may be considered. (implicitly or explicitly) from client computers 802 by 
Therefore, when the process illustrated in FIG. 7 terminates server 806 over network 804. Clients 802 may also query 
the list RATS[ ] may include (in decreasing order) predicted server 806 regarding the information stored in data memory 
ratings of the given item for the corresponding users in 25 810 and disk 814. In particular, a client computer may 
USER[]. Further, the list of users produced by the process su PP ! y server 806 Wlth a 8 iven user and a S iven lte m. Server 
illustrated in FIG. 7 may be a list of users who are predicted 806 ma y compute a projected rating of the given item for the 
to like the given item more than the other users. S iven user based on the information stored in a database on 

As in the case of an "extreme" query a "target" query may disk81 l in mem ? fy 81 °' S ™ CV 806 may rep ° n 

have e-commerce applications. For example, consider the 30 P redicted ratlD 8 to a chenl computer, 

case in which for marketing purposes a company may wish Although illustrated and described herein with reference 

to develop a list of customers or potential customers who are t0 certain exemplary embodiments, the present invention is 

predicted to like a given product. A music CD distributor nevertheless not intended to be limited to the details shown, 

may, for instance, wish to obtain a list of customers which Rather, various modifications may be made in the details 

are predicted to like a given recording. A "target" query may 35 within the scope and range of equivalents of the claims and 

help to provide a list of customers who are predicted to without departing from the spirit of the invention, 

appreciate the given recording. What is claimed: 

Responses to other queries may also be deduced by LA method for predicting a rating of a plurality of ratings 

building upon a method for predicting ratings, such as, for associated with a user of a plurality of users, the rating 

example, the method illustrated in FIG. 1. As noted above 40 corresponding to an item of a plurality of items, said method 

with respect to an "extreme" and a "target" query other comprising the steps of: 

queries may also have e-commerce applications. Some (a) providing, for each of the plurality of users, one of the 

exemplary queries are given in the following: plurality of ratings corresponding to at least one of the 

1. What is the predicted rating of a given item for a given plurality of items; 

user ? ( b ) calculating a predictability relation between ones of 

2. Produce a list of users who have rated the most items the Polity ^ users and other ones of the plurality of 
in common with a given user (these items may be based on the result of ste P 0* 

restricted to a given category). (c) assigning one of a plurality of nodes to each of the 

3. Produce a list of users with whom the ratings of a given 50 plurality of users; 

user are most similar (this comparison may be made by (d) connecting ones of the plurality of nodes with other 

restricting ratings to items in a given category). ones of the plurality of nodes by a plurality of edges 

4. Produce a list of users with whom the ratings of a given based 011 the predictability relation; 

user are least similar (this comparison may be made by (e) searching a graph which includes the plurality of 

restricting ratings to items in a given category). 55 nodes and the plurality of edges for a path from a node 

In addition similar techniques to those employed for assigned to the user of the plurality of users to an other 

producing responses to queries may be applied in order to node assigned to an other user of the plurality of users; 

provide users with personalized recommendations. For and 

example, upon entering a computer system a user may be (f) calculating the rating of the plurality of ratings asso- 

presented with a promotional list of items based on predicted 60 ciated with the user of the plurality of users based on 

ratings. Further, real-time recommendations of items may be the path and the predictability relation, 

made to a user based on items the user just purchased or 2. The method of claim 1, wherein the plurality of users 

inquired about. Real-time advertisements may selected and are a plurality of customers, the plurality of items represent 

shown to a user viewing a Web page. For example, if a user a plurality of products for sale, and the plurality of ratings 

searches the Internet for information regarding a jazz music 65 are an indication of satisfaction of a customer of the plurality 

CD, then advertisements for other music CDs that the user of customers with a product of sale of the plurality of 

is predicted to like may be displayed to the user. products for sale. 
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3. The method of claim 1, wherein step (e) includes 
searching the graph for a shortest path from the node to the 
other node, the other user having provided any of the 
plurality of ratings corresponding to the item. 

4. The method of claim 1, wherein the path from the node 
to the other node searched for in step (e) includes less than 
a predetermined number of edges. 

5. The method of claim 1, wherein step (b) includes 
determining a plurality of transformations of ratings corre- 
sponding to the predictability relation based on the result of 
step (a). 

6. The method of claim 5, wherein step (b) further 
includes determining a plurality of prediction values, each of 
the plurality of prediction values associated with one of the 
plurality of transformations of ratings. 

7. The method of claim 6, wherein step (f) includes the 
steps of: 

composing ones of the plurality of transformations of 

ratings based on the path, and 
calculating the rating based on the composition of the 

ones of the plurality of transformations and ones of the 

plurality of prediction values associated with the ones 

of the plurality of transformations. 

8. The method of claim 1, further comprising the steps of: 
partitioning the plurality of items into a plurality of 

categories; 

selecting a category of the plurality of categories; 

repeating steps (e) and (f) to calculate a respective rating 
corresponding to each respective item of the category, 
the respective rating associated with the user; and 

sorting the respective items of the category according to 
the corresponding respective ratings. 

9. The method of claim 1, further comprising the steps of: 
partitioning the plurality of items into a plurality of 

categories; 

selecting a category of the plurality of categories; 

repeating steps (e) and (f) to calculate a respective rating 
corresponding to each respective item of the category, 
the respective rating associated with the user; and 

reporting a preferred item of the plurality of items corre- 
sponding to a highest rating of the respective ratings of 
each respective item of the category. 

10. The method of claim 1, further comprising the steps 

of: 

partitioning the plurality of items into a plurality of 
categories; 

selecting a category of the plurality of categories; 

repeating steps (e) and (f) to calculate a respective rating 
corresponding to each respective item of the category, 
the respective rating associated with the user; and 

reporting a rejected item of the plurality of items corre- 
sponding to a lowest rating of the respective ratings of 
each respective item of the category. 

11. The method of claim 1, further comprising the steps 

of: 

repeating steps (e) and (f) to calculate a respective rating 
associated with each respective user of the plurality of 
users, the respective rating corresponding to the item; 
and 

sorting the respective users according to the respective 
ratings associated with each respective user. 

12. An e-commerce method for producing a predicted 
rating of a plurality of ratings indicating a level of satisfac- 
tion of a given customer of a plurality of customers, the 
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predicted rating corresponding to a product of a plurality of 
products for sale, said method comprising the steps of: 

(a) providing, for each of the plurality of customers, one 
of the plurality of ratings corresponding to at least one 

5 of the plurality of products for sale; 

(b) calculating a predictability relation between ones of 
the plurality of customers and other ones of the plu- 
rality of customers based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
10 plurality of customers; 

(e) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 
based on the predictability relation; 

15 (f) searching a graph which includes the plurality of nodes 
and the plurality of edges for a path from a node 
assigned to the given customer of the plurality of 
customers to an other node assigned to an other cus- 
tomer of the plurality of customers which provided a 

20 rating of the plurality of ratings corresponding to the 
product; and 

(g) calculating the predicted rating associated with the 
customer based on the path and the rating provided by 
the other customer. 
25 13. The e-commerce method of claim 12, further com- 
prising the steps of: 

partitioning the plurality of products for sale into a 

plurality of categories; 
selecting a category of the plurality of categories; 
30 repeating steps (f) and (g) to calculate a respective pre- 
dicted rating corresponding to each respective product 
for sale of the category, the respective predicted rating 
associated with the given customer; and 
sorting the products for sale of the category according to 
35 the corresponding respective predicted ratings. 

14. The e-commerce method of claim 12, further com- 
prising the steps of: 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating associated with each respective given 
40 customer of the plurality of customers, the respective 
predicted rating corresponding to the product for sale; 
and 

sorting the respective given customers according to the 
respective predicted ratings associated with each 
respective given customer. 

15. An article of manufacture comprising a computer 
usable medium having computer readable program code 
means embodied therein for predicting a rating of a plurality 

5Q of ratings associated with a user of a plurality of users, the 
rating corresponding to an item of a plurality of items, the 
computer readable program code means in said article of 
manufacture comprising computer readable program code 
means for causing a computer to effect: 
55 (a) providing, for each of the plurality of users, one of the 
plurality of ratings corresponding to at least one of the 
plurality of items; 

(b) calculating a predictability relation between ones of 
the plurality of users and other ones of the plurality of 

60 users based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
plurality of users; 

(d) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 

65 based on the predictability relation; 

(e) searching a graph which includes the plurality of 
nodes and the plurality of edges for a path from a node 
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assigned to the user of the plurality of users to an other 
node assigned to an other user of the plurality of users; 
and 

(f) calculating the rating of the plurality of ratings asso- 
ciated with the user of the plurality of users based on 5 
the path and the predictability relation. 

16. An article of manufacture comprising a computer 
usable medium having computer readable program code 
means embodied therein for producing a predicted rating of 

a plurality of ratings indicating a level of satisfaction of a 10 
given customer of a plurality of customers, the predicted 
rating corresponding to a product of a plurality of products 
for sale, the computer readable program code means in said 
article of manufacture comprising computer readable pro- 
gram code means for causing a computer to effect: 15 

(a) providing, for each of the plurality of customers, one 
of the plurality of ratings corresponding to at least one 
of the plurality of products for sale; 

(b) calculating a predictability relation between ones of 
the plurality of customers and other ones of the plu- 
rality of customers based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
plurality of customers; 

(e) connecting ones of the plurality of nodes with other 25 
ones of the plurality of nodes by a plurality of edges 
based on the predictability relation; 

(f) searching a graph which includes the plurality of nodes 
and the plurality of edges for a path from a node 
assigned to the given customer of the plurality of 30 
customers to an other node assigned to an other cus- 
tomer of the plurality of customers which provided a 
rating of the plurality of ratings corresponding to the 
product; and 

(g) calculating the predicted rating associated with the 35 
customer based on the path and the rating provided by 
the other customer. 

17. An article of manufacture as recited in claim 16, the 
computer readable program code means in said article of 
manufacture further comprising computer readable program *o 
code means for causing a computer to effect: 

partitioning the plurality of products for sale into a 
plurality of categories; 

selecting a category of the plurality of categories; 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating corresponding to each respective product 
for sale of the category, the respective predicted rating 
associated with the given customer; and 

sorting the products for sale of the category according to 50 
the corresponding respective predicted ratings. 

18. An article of manufacture as recited in claim 16, the 
computer readable program code means in said article of 
manufacture further comprising computer readable program 
code means for causing a computer to effect: 55 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating associated with each respective given 
customer of the plurality of customers, the respective 
predicted rating corresponding to the product for sale; 



45 



and 



60 



sorting the respective given customers according to the 
respective predicted ratings associated with each 
respective given customer. 
19. A storage device readable by machine, tangibly 
embodying a program of instructions executable by the 65 
machine to perform method steps for predicting a rating of 
a plurality of ratings associated with a user of a plurality of 



users, the rating corresponding to an item of a plurality of 
items, said method comprising the steps of: 

(a) providing, for each of the plurality of users, one of the 
plurality of ratings corresponding to at least one of the 
plurality of items; 

(b) calculating a predictability relation between ones of 
the plurality of users and other ones of the plurality of 
users based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
plurality of users; 

(d) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 
based on the predictability relation; 

(e) searching a graph which includes the plurality of 
nodes and the plurality of edges for a path from a node 
assigned to the user of the plurality of users to an other 
node assigned to an other user of the plurality of users; 
and 

(f) calculating the rating of the plurality of ratings asso- 
ciated with the user of the plurality of users based on 
the path and the predictability relation. 

20. A storage device readable by machine, tangibly 
embodying a program of instructions executable by the 
machine to perform method steps for producing a predicted 
rating of a plurality of ratings indicating a level of satisfac- 
tion of a given customer of a plurality of customers, the 
predicted rating corresponding to a product of a plurality of 
products for sale, said method comprising the steps of: 

(a) providing, for each of the plurality of customers, one 
of the plurality of ratings corresponding to at least one 
of the plurality of products for sale; 

(b) calculating a predictability relation between ones of 
the plurality of customers and other ones of the plu- 
rality of customers based on the result of step (a); 

(c) assigning one of a plurality of nodes to each of the 
plurality of customers; 

(c) connecting ones of the plurality of nodes with other 
ones of the plurality of nodes by a plurality of edges 
based on the predictability relation; 

(f) searching a graph which includes the plurality of nodes 
and the plurality of edges for a path from a node 
assigned to the given customer of the plurality of 
customers to an other node assigned to an other cus- 
tomer of the plurality of customers which provided a 
rating of the plurality of ratings corresponding to the 
product; and 

(g) calculating the predicted rating associated with the 
customer based on the path and the rating provided by 
the other customer. 

21. The storage device as recited in claim 20, the program 
of instructions tangibly embodied in said storage device 
further comprising instructions to perform method steps 
executable by the machine of: 

partitioning the plurality of products for sale into a 
plurality of categories; 

selecting a category of the plurality of categories; 

repeating steps (t) and (g) to calculate a respective pre- 
dicted rating corresponding to each respective product 
for sale of the category, the respective predicted rating 
associated with the given customer; and 
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sorting the products for sale of the category according to 

the corresponding respective predicted ratings. 
22. The storage device as recited in claim 20, the program 
of instructions tangibly embodied in said storage device 
further comprising instructions to perform method steps 5 
executable by the machine of: 

repeating steps (f) and (g) to calculate a respective pre- 
dicted rating associated with each respective given 
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customer of the plurality of customers, the respective 
predicted rating corresponding to the product for sale; 
and 

sorting the respective given customers according to the 
respective predicted ratings associated with each 
respective given customer. 

* * * * * 
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